Multiple Three-Dimensional (3-D) Inspection Renderings

ABSTRACT

An X-ray inspection system includes at least one display monitor and a console. The console includes at least two different visualization algorithms and a processor. The processor is configured to process volumetric image data with a first of the at least two different visualization algorithms and produce first processed volumetric image. The processor is further configured to process the volumetric image data with a second of the at least two different visualization algorithms and produce second processed volumetric image. The processor is further configured to concurrently display the first and second processed volumetric image data via the display monitor. The volumetric image data is indicative of a scanned object and items therein.

TECHNICAL FIELD

The following generally relates to an imaging inspection system and moreparticularly to multiple simultaneous three-dimensional (3-D) inspectionrenderings of the imaging inspection system.

BACKGROUND

A computed tomography (CT) imaging inspection system has been used inthe detection of contraband such as explosives, and/or other prohibiteditems at an airport security checkpoint and/or other location. Such animaging inspection system generates three-dimensional (3-D) volumetricimage data of the scanned luggage and/or baggage and items therein. Theidentification of the contraband may then be made by a combination ofimage processing of the volumetric image data with an inspectionsoftware and visual inspection of the displayed volumetric image data byinspection personnel.

A CT imaging inspection system for checked luggage and/or baggage hasonly provided a single whole volume 3D image for display, typicallyshown with high transparency. Unfortunately, it may be difficult or notpossible to discern what an item is when displaying the itemsemi-transparently, as the perimeter and/or exterior of the item may notbe clear or visible. For carry-on luggage and/or baggage, the displayedimage has been a two-dimensional (2-D) projection image(s), such as oneor both of a top view 2-D image and a side view 2-D image. The 2-Dimage(s) has been displayed in gray-scale and/or color.

FIG. 1 shows an example of a gray-scale 2-D image 102 of carry-onluggage and/or baggage. Unfortunately, contraband may not be visiblyapparent and/or discernible in a 2-D image(s) such as the 2-D image 102.For example, the representation of a first item may obscure therepresentation of another item located below the first item. As aconsequence, certain contraband may not be detected or detectablethrough visual inspection of the 2-D image(s). In such a case, visualinspection may offer only limited utility when used in combination witha computer inspection algorithm(s).

SUMMARY

Aspects of the application address the above matters, and others.

In one aspect, an X-ray inspection system includes at least one displaymonitor and a console. The console includes at least two differentvisualization algorithms and a processor. The processor is configured toprocess volumetric image data with a first of the at least two differentvisualization algorithms and produce first processed volumetric image.The processor is further configured to process the volumetric image datawith the a second of the at least two different visualization algorithmsand produce second processed volumetric image. The processor is furtherconfigured to concurrently display the first and second processedvolumetric image data via the display monitor. The volumetric image datais indicative of a scanned object and items therein.

In another aspect, a method includes receiving volumetric image dataindicative of a scanned object and items therein from an imaginginspection system. The method further includes processing the volumetricimage data with a first visualization algorithm, producing firstprocessed volumetric image. The method further includes processing thevolumetric image data with a second visualization algorithm, producingsecond processed volumetric image. The method further includessimultaneously displaying the first processed volumetric image and thesecond processed volumetric image.

In another aspect, a computer readable medium is encoded with computerexecutable instructions which when executed by a processor causes theprocessor to: process volumetric image data generated by an imaginginspection system with a first visualization algorithm, producing firstprocessed volumetric image, process the volumetric image data with asecond visualization algorithm, producing second processed volumetricimage, and display both the first processed volumetric image and thesecond processed volumetric image.

Those skilled in the art will recognize still other aspects of thepresent application upon reading and understanding the attacheddescription.

BRIEF DESCRIPTION OF THE DRAWINGS

The application is illustrated by way of example and not limited by thefigures of the accompanying drawings, in which like references indicatesimilar elements and in which:

FIG. 1 shows an example a gray-scale 2-D image of carry-on luggage;

FIG. 2 schematically illustrates an example imaging inspection system;

FIG. 3 schematically illustrates an example conveyor assembly for theimaging inspection system;

FIG. 4 schematically illustrates an example imaging inspection systemwith a single display monitor visually presenting multiple differentlyprocessed 3-D images;

FIG. 5 schematically illustrates an example imaging inspection systemwith multiple display monitors, each visually presenting a differentlyprocessed 3-D image;

FIG. 6 schematically illustrates a first example of two differentlyprocessed 3-D images with contraband;

FIG. 7 schematically illustrates another example of two differentlyprocessed 3-D images with contraband;

FIG. 8 schematically illustrates yet another example of two differentlyprocessed 3-D images;

FIG. 9 schematically illustrates the two differently processed 3-Dimages of FIG. 8 synchronously rotated;

FIG. 10 schematically illustrates still another example of twodifferently processed 3-D images;

FIG. 11 schematically illustrates the two differently processed 3-Dimages of FIG. 10 synchronously rotated and zoomed;

FIG. 12 schematically illustrates an example method in accordance withan embodiment described herein;

FIG. 13 shows an example first plot for a first opacity mapping for afirst visualization algorithm for a first of the two differentlyprocessed 3-D images; and

FIG. 14 shows an example second plot for a second opacity mapping for asecond visualization algorithm for a second of the two differentlyprocessed 3-D images.

DETAILED DESCRIPTION

FIG. 2 schematically illustrates an example imaging inspection system200. The illustrated imaging inspection system 200 is configured to scanan object 202 (e.g., luggage, baggage, etc.) and items 203 therein, anddetect contraband items, such as explosives, and/or other prohibiteditems of the items 203. The imaging inspection system 200, in oneinstance, is an aviation security and/or inspection computed tomography(CT) based imaging inspection system at an airport checkpoint and/orother location. In another instance, the imaging inspection system 200is configured for non-destructive testing, medical, and/or otherimaging.

The illustrated imaging inspection system 200 includes a stationaryframe 204 with an aperture 206 and a rotating frame 208. The rotatingframe 208 is rotatably supported in the aperture via a bearing 210,which includes a first portion 212 affixed to the stationary frame 204and a second portion 214 affixed to the rotating frame 208. The rotatingframe 208 rotates about an examination region 216. The rotating frame208 supports a radiation source(s) 218 (e.g., an ionizing X-ray source,etc.) and a detector array 220, which is disposed diametrically oppositethe radiation source(s) 218, across the examination region 216. Aconveyor assembly 222 supports the object 202 in the examination region216, including moving the object through the examination region 216.

Briefly turning to FIG. 3, an example of a side view of a portion of asuitable conveyor assembly 222 is illustrated. In FIG. 3, the conveyorassembly 222 includes a continuous belt 302 supported by two opposingpulleys 304 and four idler pulleys 306. The conveyor assembly 222further includes a drive system(s) 308, which include at least acontroller 310, which controls a motor 312 to drive an actuator 314(e.g., a belt, a gear, a ball screw, a lead screw, etc.) to rotate oneor more of the pulleys 304 and/or 306 to translate the belt 302. Anexample of a suitable conveyor assembly 22 is described in U.S. Pat. No.7,072,434, filed Jan. 15, 2044, and entitled “Carry-on baggagetomography scanning system,” the entirety of which is incorporatedherein by reference.

Returning to FIG. 2, during an examination of the object(s) 202, theradiation source(s) 218 emits radiation, which is collimated, e.g., viaa collimator 224, to produce a fan, cone, wedge, and/or other shapedradiation beam 226, which traverses the examination region 216,including the object 202 and items 203, which attenuate or absorbradiation based on, e.g., a material composition and/or density of theobject 202 and items 203. The detector array 220 includes a 1-D or 2-Darray of detectors, which detect the radiation and generates anelectrical signal(s) (projection data) indicative of an attenuation bythe object 202 and items 203. An image reconstructor 228 reconstructsthe electrical signal(s), generating volumetric image data indicative ofthe object 202 and the items 203.

A computer 230 is configured to provide a signal(s) that controlscomponents such as the rotating frame 208, the radiation source 218, thedetector array 220 and the conveyor assembly 222 for scanning, the imagereconstructor 228 for generating the volumetric image data, and toreceive the volumetric image data from the image reconstructor 228 andprocess and display the volumetric image data via a display monitor(s)232, which can be part of and/or in electrical communication with thecomputer 230. The computer 230 is also configured with an inputdevice(s) to receive user input, which controls an operation(s) such asa speed of gantry rotation, kVp, mA, etc.

The computer 230 includes a processor 234 (e.g., a microprocessor, acentral processing unit, a controller, etc.) and a user interfacealgorithm(s) 236. The processor 230 executes the user interfacealgorithm(s) 236 and generates a user interface(s), which is displayedwith the display monitor(s) 232. In one instance, the user interface isa graphical user interface (GUI) with a single view port to display a3-D image. In another instance, the GUI includes two view ports forconcurrent and/or simultaneous display of two different 3-D images. Inyet another instance, the GUI includes N (N>2) view ports to display Nimages, one in each view port.

The computer 230 further includes a visualization or renderingalgorithm(s) 238. As described in greater detail below, in one instance,the rendering algorithm(s) 238 includes at least two differentalgorithms for generating at least two different 3-D images of theobject 202 and the items 203 emphasizing different characteristics(e.g., material composition, surface, etc.) of the object 202 and theitems 203, and the processor 234 concurrently and/or simultaneouslydisplays the at least two different 3-D images in different view portsof the display monitor(s) 232. In one instance, concurrent and/orsimultaneous display of the at least two 3-D images allow a user to morequickly and accurately identify the items 203, relative to aconfiguration in which only a single rendering algorithm 238 isutilized, e.g., by showing a more complete representation of identifythe items, simultaneously, which, in one instance, can speed up and/orimprove the inspection process, e.g., for clearing threats.

The computer 230 further includes an image processing detectionalgorithm(s) 240. The processor 234 executes the image processingdetection algorithm(s) 240 to process the volumetric image data andidentify contraband in the object 202 therefrom. Non-limiting examplesof detection algorithms include, but are not limited to, U.S. Pat. No.7,190,757 B2, filed May 21, 2004, and entitled “Method of and system forcomputing effective atomic number images in multi-energy computedtomography,” U.S. Pat. No. 7,302,083 B2, filed Jul. 1, 2004, andentitled “Method of and system for sharp object detection using computedtomography images,” and U.S. Pat. No. 8,787,669 B2, filed Sep. 30, 2008,and entitled “Compound object separation,” all of which are incorporatedherein by reference in their entireties.

It will be appreciated that the example component diagram is merelyintended to illustrate an embodiment of a type of imaging modality andis not intended to be interpreted in a limiting manner. For example, thefunctions of one or more components described herein may be separatedinto a plurality of components and/or the functions of two or morecomponents described herein may be consolidated into merely a singlecomponent. Moreover, the imaging modality may comprise additionalcomponents to perform additional features, functions, etc.

FIG. 4 illustrates an example in which the displays 232 include a singledisplay 402.

The user interface algorithm(s) 236 includes at least an algorithm 410for generating a single GUI 404, with at least two view ports 406 ₁, . .. , 406 _(N) (where N is an integer equal to or greater than two),rendered in the single display 402. Each at least two view ports 406 ₁,. . . , 406 _(N) displays a 3-D image, 408 ₁, . . . , 408 _(N). Each 3-Dimage 408 ₁, . . . , 408 _(N) is displayed from a vantage point of aview plane through the 3-D image and into a remaining depth of the 3-Dimage, wherein the portion of the 3-D image in front of the view planeis rendering transparent or not rendered.

The rendering algorithm(s) 238 includes at least a first algorithm 412 ₁for a generating semi-transparent 3-D rendering and an m-th algorithm412 _(N) for generating a surface 3-D rendering. A suitablesemi-transparent rendering uses transparency and/or colors to representthe object 202 as a semi-transparent volume. For example, the outside ofthe object 202 and/or one or more of the items 203 is displayed assemi-transparent so that it does not visually conceal other items 203there behind. A suitable surface rendering algorithm uses a thresholdvalue of radiodensity (to see through the outer cloth but detect itemsof interest inside) and edge detection to detect surfaces of the items203 in the object 202, where only the surface closest to the user (theview plane) is visible.

In one instance, having at least shape recognition from the surfacerendering and the semi-transparent rendering can speed up the processfor clearing threats since each rendering visually displays the items203 of the object 202 differently. For example, the semi-transparentrendering can facilitate quick identification of an item as an item ofinterest and the surface rendering can facilitate identifying what theseitems are. The multiple renderings in the view ports 406 ₁, . . . , 406_(N) can be manipulated independently or synchronously to a single useraction for operations such as zoom, rotate, pan, contrast, brightness,opacity and/or other operation. Manipulating both in synchronization mayreduce user interaction and optimize workflow. The manipulation can beperformed via a mouse, keyboard, and/or touchscreen, e.g., using bothsingle and multi-touch gestures.

FIG. 5 illustrates a variation in which the displays 232 includes atleast two displays 502 ₁, . . . , 502 _(N), and the user interfacealgorithm(s) 236 includes at least two algorithms 410 ₁, . . . , 410_(N), for generating at least two GUIs 504 and 506, one in each of thedisplays 502 ₁, . . . , 502 _(N), and each respectively visuallypresenting at least one view port 508 and 510, each respectivelydisplaying a 3-D image 512 and 514 generated with different algorithmsof the rendering algorithm(s) 238.

In another variation, the embodiment of FIGS. 4 and 5 are combined,e.g., for an embodiment which includes more than one display 232, whereat least one of the displays 232 visually presents a GUI with multipleview ports that display views of volumetric image data processed usingdifferent rendering algorithms of the rendering algorithms 238. In oneinstance, all of the displays 232 include multiple view ports. Inanother instance, at least one of the displays includes only a singleview port.

FIG. 6 shows the single GUI 404 with the two view ports 406 ₁, . . . ,406 _(N).

The view port 406 ₁ presents the 3-D image 408 ₁ generated with thesemi-transparent algorithm 412 ₁, and the view port 406 _(N) presentsthe 3-D image 408 _(N) generated with the surface algorithm 412 _(N). Inthis example, each of the algorithms 412 ₁, . . . , 412 _(N) includes acolor lookup table (LUT) that maps each voxel in the volumetric imagedata to a specific color in the Hue/Saturation/Value (HSV) color modeland/or gray value, e.g., in a gray scale range, and an opacity tablethat maps each voxel to a specific transparency. The LUT and/or opacityis different for each algorithm 412 ₁, . . . , 412 _(N). One or both ofthe algorithms 412 ₁, . . . , 412 _(N) also provide shading.

In this example, the items 203 include at least a pair of scissors 602and a container 604 filled with a fluid, where the simultaneousobservation makes it easier to locate the pair of scissors 602 andcontainer 604. For example, the 3-D image 408 ₁ makes it easier tolocate metallic items such as the pair of scissors 602 and containersholding fluids, at least since different material compositions aredifferent colored and items behind items are visible, but notnecessarily identify what those items 203 are, and the 3-D image 408_(N) makes it easier to identify what those items 203 are—a pair ofscissors and a container, but not with discerning those particular itemswithin all of the other items 203 at least since all of the surface aresimilar represented in gray scale.

In this example, the semi-transparent algorithm 412 ₁ provides atraditional rendering for security imaging where materials are shownusing standard industry defined colors with standard industry definedtransparency levels that allows a user to see through or inside theobject 202 and/or the items 203 therein, which may facilitate findingconcealed items. For instance, outer cloth of the object 202 is shownvirtually completely transparent, the container 604 is shownsemi-transparent and with one color where an item 606 can be seen therethrough, and the pair of scissors 602 is shown virtually non-transparentand with a different color, since the material composition (e.g., metalvs plastic) of the container and the scissors is different. Thetransparency level, in general, corresponds to the material composition,and can vary across the items 203, with items less likely to becontraband rendered more transparent. Shading is not used. An exampleopacity mapping 1300 for the semi-transparent algorithm 412 ₁ is shownin FIG. 13, where a first axis 1302 represents opacity and a second axis1304 represents CT number (e.g., in Hounsfield units).

In contrast, the surface algorithm 412 _(N) instead utilizes a differentLUT and a different opacity table, (e.g., with lower transparencylevels, e.g., opaque) for showing surfaces of the items 203, which willmore closely visually match a physical outer appearance of the items203. For example, the outer cloth of the object 202 is likewise shownvirtually completely transparent, e.g., due to thresholding. However,the surface of the container 604 is shown opaque such that the inside ofthe container 604 is not visible and neither is the item 606 behind thecontainer 604. Likewise, the surface of the pair of scissors 602 isshown opaque such items there behind are not visible. The items 203 areall shown using gray scale levels with shading representing depth.Generally, items 203 behind surfaces of other items 203 in the viewplane are not visible through the surfaces in the view. An examplesurface rendering algorithm is ray casting, which locates a ray-surfaceintersection in the volumetric data. An example opacity mapping 1400 forthe surface algorithm 412 _(N) is shown in FIG. 14, where a first axis1402 represents opacity and a second axis 1404 represents CT number(e.g., in Hounsfield units).

FIG. 7 shows another example with the GUI 404 with the two view ports406 ₁, . . . , 406 _(N). In this example, the items 203 include at leasta knife 702, where the simultaneous observation makes it easier tolocate and identify the knife 702. For example, the 3-D image 408 ₁makes it easier to locate a metallic item such as the knife 702, but notclearly identify what that metallic item is at least since parts of itare almost completely transparent and other parts of it are concealed bycombined with other items, and the 3-D image 408 _(N) makes it easier toidentify what the metallic item is—the knife 702 at least since theblade is more apparent, but not clearly locate the item at least sinceit is mostly visually obstructed by another item 704 in front of it.

FIGS. 8 and 9 show another a GUI with the two view ports. In thisexample, the GUI is configured so that at least a rotation toolsynchronously rotates the 3-D images in both view ports such thatrotating (e.g., via a mouse, keyboard, touchscreen, etc.) the volumetricimage data in either of the view ports automatically causes thevolumetric image data in the other view port to similarly rotate.

FIGS. 10 and 11 show another a GUI with the two view ports. In thisexample, the GUI is configured so that at least a zoom toolsynchronously zooms the 3-D images in both view ports such that zooming(e.g., via a mouse, keyboard, touchscreen, etc.) the volumetric imagedata in either of the view ports automatically causes the volumetricimage data in the other view port to similarly zoom.

As described herein, in one instance, a screen layout provides for adual 3-D image display of volumetric image data side-by-side on screen,where one displayed 3-D volume provides a semi-transparent rendering forseeing inside and through objects, and the other displayed 3-D volumeprovides a surface rendering for seeing shapes and contours of items andthe object 202. The semi-transparent image provides the operator withthe sense of layers, which can be added or removed through adjustment inopacity, whereas the surface rendered display gives the operatorinformation of the surface structure.

FIG. 12 illustrates an example method.

It is to be understood that the following acts are provided forexplanatory purposes and are not limiting. As such, one or more of theacts may be omitted, one or more acts may be added, one or more acts mayoccur in a different order (including simultaneously with another act),etc.

At 1202, an object is scanned with the imaging inspection system 200,producing view data.

At 1204, the view data is reconstructed, producing volumetric image dataof the object.

At 1206, the volumetric image data is processed with detection softwarefor computerized detection of contraband in the items 203.

At 1208, a first visualization algorithm is applied to the volumetricimage data, producing first processed volumetric image data, asdescribed herein and/or otherwise.

At 1210, a second different visualization algorithm is applied to thevolumetric image data, producing second different processed volumetricimage data, as described herein and/or otherwise.

At 1212, the first and the second volumetric image data are concurrentlydisplayed, as described herein and/or otherwise.

The methods described herein may be implemented via one or moreprocessors executing one or more computer readable instructions encodedor embodied on computer readable storage medium which causes the one ormore processors to carry out the various acts and/or other functionsand/or acts. Additionally or alternatively, the one or more processorscan execute instructions carried by transitory medium such as a signalor carrier wave.

The application has been described with reference to variousembodiments. Modifications and alterations will occur to others uponreading the application. It is intended that the invention be construedas including all such modifications and alterations, including insofaras they come within the scope of the appended claims and the equivalentsthereof.

What is claimed is:
 1. An X-ray inspection system, comprising: at leastone display monitor; a console, including: at least two differentvisualization algorithms; a processor configured to process volumetricimage data with a first of the at least two different visualizationalgorithms and produce first processed volumetric image, process thevolumetric image data with a second of the at least two differentvisualization algorithms and produce second processed volumetric image,concurrently display the first and second processed volumetric imagedata via the display monitor, wherein the volumetric image data isindicative of a scanned object and items therein.
 2. The X-rayinspection system of claim 1, wherein the first visualization algorithmincludes a first color look up table and opacity table pair and thesecond visualization algorithm includes a second color look up table andopacity table pair, wherein the first color look up table and opacitytable pair is different from the second color look up table and opacitytable pair.
 3. The X-ray inspection system of claim 2, wherein the firstcolor look up table and opacity table pair assigns a color and atransparency level to a voxel of the first processed volumetric imagebased on a material composition represented by the voxel.
 4. The X-rayinspection system of claim 3, wherein the first color look up table andopacity table pair assigns a first color and a first transparency levelto a first voxel of the first processed volumetric image and a seconddifferent color and a second different transparency level to a seconddifferent voxel of the first processed volumetric image where the firstand second voxels represent different material compositions.
 5. TheX-ray inspection system of claim 4, wherein at least one of the first orsecond transparency levels renders at least one of the first or secondvoxels semi-transparent, and voxels located behind the at least one ofthe first or second voxels are visible through the at least one of thefirst or second semi-transparent voxels in the displayed first processedvolumetric image.
 6. The X-ray inspection system of claim 3, wherein thesecond color look up table and opacity table pair assigns a color andtransparency level to a voxel of the second processed volumetric imagerepresenting a surface of an item, which renders the voxel opaque. 7.The X-ray inspection system of claim 6, wherein the second color look uptable and opacity table pair assigns different shading to voxelsrepresenting the surface of the item as a function of depth from a viewplane of the display monitor into the second processed volumetric image.8. The X-ray inspection system of claim 1, wherein the first and secondprocessed volumetric image data are rendered side-by-side.
 9. The X-rayinspection system of claim 1, further including: a rotating frame; aradiation source disposed on the rotating frame; a detector arraydisposed opposite the radiation source on the rotating frame, across anexamination region, and a conveyor belt at least partially in theexamination region; wherein the radiation source emits radiation whilerotating and the detector array detected radiation while rotating, andthe image reconstructor generates the tomographic volumetric image datafrom an output of the detector array.
 10. The X-ray inspection system ofclaim 1, wherein the first and second processed volumetric image datainclude voxels representing a contraband item in the object.
 11. Amethod, comprising: receiving volumetric image data indicative of ascanned object and items therein from an imaging inspection system.processing the volumetric image data with a first rendering algorithm,producing first processed volumetric image; processing the volumetricimage data with a rendering visualization algorithm, producing secondprocessed volumetric image; and simultaneously displaying the firstprocessed volumetric image and the second processed volumetric image.12. The method of claim 11, wherein the first processed volumetric imageand the second processed volumetric image are displayed in view ports ofa same display monitor.
 13. The method of claim 11, wherein the firstprocessed volumetric image is displayed in a first view port in a firstdisplay monitor, and the second processed volumetric image is displayedin a second view port in a second different display monitor.
 14. Themethod of claim 11, further comprising: receiving a user input for atleast one of rotating, zooming and panning one of the first and secondprocessed volumetric image data; and rotating, zooming and panning bothof the first and second processed volumetric image data insynchronization in response thereto.
 15. The method of claim 11, furthercomprising: receiving a user input for at least one of rotating, zoomingand panning one of the first and second processed volumetric image data;and rotating, zooming and panning only the one of the first and secondprocessed volumetric image data in response thereto.
 16. The method ofclaim 11, further comprising: receiving a user input indicative of atleast a contrast, a brightness and an opacity level of one of the firstand second processed volumetric image data; and setting at least one ofthe contrast, the brightness and the opacity level of both of the firstand second processed volumetric image data in synchronization inresponse thereto.
 17. The method of claim 11, further comprising:receiving a user input indicative of at least a contrast, a brightnessand an opacity level of one of the first and second processed volumetricimage data; and setting at least one of the contrast, the brightness andthe opacity level of only the one of the first and second processedvolumetric image data in response thereto.
 18. The method of claim 11,wherein the first visualization algorithm renders voxels of the firstprocessed volumetric image data semi-transparent, wherein a degree oftransparency is based on a material composition of an item representedby a voxel.
 19. The method of claim 18, wherein the second visualizationalgorithm renders voxels of the second processed volumetric image datarepresenting surfaces of item in the object opaque.
 20. A computerreadable medium encoded with computer executable instructions which whenexecuted by a processor causes the processor to: process volumetricimage data generated by an imaging inspection system with a firstvisualization algorithm, producing first processed volumetric image;process the volumetric image data with a second visualization algorithm,producing second processed volumetric image; and display both the firstprocessed volumetric image and the second processed volumetric image.